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Abstract 



We propose a Markov jump process with the three state herding interaction. We 
see our approach as an agent-based model for the financial markets. Under certain as- 
sumptions this agent-based model can be related to the stochastic description exhibiting 
sophisticated statistical features. Along with power-law probability density function of the 
absolute returns we are able to reproduce the fractured power spectral density, which is 
observed in the high-frequency financial market data. Given example of consistent agent- 
based and stochastic modeling will provide background for the further developments in 
the research of complex social systems. 

PACS: 89.65.Gh, 02.50.Ga, 05.10.Gg. 

1 Introduction 

Following the recent financial crisis a vast number of papers suggesting what could be improved 
in the financial policy making and Economics itself were published. In these papers agent- 
based modeling was seen as one of the key tools, which could improve the understanding of the 
financial markets as well as lead to the potential applications [1, 2, -3]. While the idea is not 
so new, see a paper by Axelrod published back in the 1997, ref. [ but it has been actively 
developed only in the last few years and is seen as one of the potential future prospects [5]. 

Currently there are many differing agent-based approaches in the modeling of the financial 
markets [6, 7]. Reference [ ] suggests that the ideal financial market model should be both 
realistic, namely include realistic individual trader behavior (with the best example being [8]), 
and tractable, namely have an analytical solution (ex. see an analytical solution of the Minority 
Game by Challet et al. [• ]). This raises an interesting point - one has to build bridges between 
microscopic and macroscopic modeling, because doing so might lead to the ideal model. And 
this actually currently being done. In the recent paper Krause et al. [10] proposed a macro- 
scopic stochastic model analogous to the Ising model interpretation for the financial markets, 
introduced in [1 1]. Another interesting approach was made by Feng et al. [ .-] who have used 
empirical observations and trader survey data to construct agent-based and stochastic models 
for the financial markets. 

Our approach is based on the integration of two alternatives. One of them is a very simple, 
yet very relevant and highly applicable [13, 14], Markov jump process based on the Kirman's 
agent-based herding model, introduced in [15]. And the other one is a very general stochastic 
model [16, 17, 18], which was built for the modeling of return and trading activity in the 
financial markets [19, 20, 21]. 

In the previous articles [22, 23] we have used the Kirman's herding transition rates to derive 
a stochastic model for the absolute returns. In this approach we generalized and extended the 
work by Alfarano et al. [24, 25]. By doing so we have established the relations between the 
Markov jump process and a very general class of stochastic equations. 
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generating power-law statistics. Namely the time series obtained by solving eq. (1) posses 
power-law stationary probability density and power spectral density as follows: 



p{x) ~ X 



S{f) ~ 1/f, /3 = 1 + 



A-3 



(2) 



2(r/-l)- 



Stochastic differential equation (f ) was previously derived from the point processes and its abil- 
ity to reproduce power-law statistics was grounded in [16, 17, 18]. Many physical, physiological, 
and social systems are characterized by complex interactions among different components and 
power-law correlations in the output of these systems [26, 27, 28, 29, 30, 31]. The applications of 
such stochastic model might include varying complex systems possessing power-law statistical 
features. 

In this paper we considerably extend agent-based herding model introducing the Markov 
jumps between three states available to agents (these states may be alternatively seen as agent 
groups). This approach lets us reproduce the fractured power spectral density, which is an 
important statistical feature of the high-frequency empirical financial market data [19, 20, 21, 
32]. First we introduce a possible relation between the Markov jump process and power-law 
stochastic processes, define herding interaction between three agent groups, introduce possible 
application for the financial markets. Next we give a stochastic treatment for the new approach 
and finally we discuss results in the context of microscopic and macroscopic modeling. 

2 The Markov jump process in the background of the 
power-law stochastic processes 

We choose the Markov jump process as a basic stochastic process, which enables the repro- 
duction of the agent dynamics on the microscopic scale. This approach is already in use in 
restructuring Macroeconomics [13] and building microscopic models for the financial markets 
[1 1] . The method works as a more detailed reasoning for the microscopic behavior is irrelevant 
determining the macroscopic description. 

Let us start from the model with agents facing binary choice (0 or 1). The state variable 
X can be considered as a number of agents making choice 1. In this case the state space is then 
{0, 1, 2, N}. One can interpret this model as a random walk, or a birth-death process, because 
X changes at most by ±1 in sufficiently small time interval At. The transition probabilities 
from state X to the states X ±1 may be specified by 



where fii{X, N) and fi2{X, N) are positive transition rate functions. The transition probabilities 
(3) and (4) appear general enough to provide wide opportunities. The most simple one, when 
the functions /ii^2 are constant, represents well-known birth-death or entry-exit process. 

One can obtain the power-law statistics starting from the ref. [15], where Kirman has 
noticed that a very similar patterns are observed in a relatively different systems. Apparently 
statistically similar herding behavior is observed in a very different fields - economics, see for 
example a paper by Becker [33], and entomology, the credits goes to Deneubourg and Pastels 
(see [3 i] for the most recent work). The entomological observations concluded that even if the 
ant colony has two identical food sources available ants still prefer to use only one of them at 
a given time. The other food source is not completely neglected as the ants after some time 
switch to it. The economists observe similar behavior - people tend to choose more popular 
product, than less popular, despite both being of a similar quality. 





(3) 
(4) 
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Figure 1: Wide spectra of obtainable probability (a) and spectral (b) density functions of stochas- 
tic variable y, dynamics of which are defined by eq. (8). Black curves are the limiting, minimum 
and maximum exponent, power-law functions with: (a) Xmin = 2 and Xmax = 5, (b) /3mm = 0.5 
and I3max = 2. Model parameters: a = 1, ei = 0.1, £2 = 0.1 (red plus), 0.5 (green cross), 1 (blue 
stars), 1.5 (magenta open squares), 2 (cyan filled squares) and 3 (orange open circles). 



Taking the discussed empirical observations into account Kirman has proposed to model 
the herding behavior as a Markovian chain with the following one step transition rates: 

fXiiX,N) =ai + hX, fX2{X,N) = a2 + h{N-X), (5) 

here h parameter defines herding behavior, as a property of the agents describing the strength 
of imitation tendencies. While cTj parameters describe an asymmetric individual transitions of 
the agents made independently of the other agents' behavior. We will demonstrate that this 
simple model of herding interaction of agents can be considered as the background of pretty 
complex power-law behavior of financial variables. 

In order to reproduce the sophisticated power-law behavior of the absolute returns in the 
financial markets we generalized the herding model by assuming that the meeting rates of the 
agents are not constant, but depend on the system state, 7^^-^, [ ]• This strengthens a 
feedback of the macroscopic state on the agent transition rates as follows: 

/xi(X,iV) = ai + ^, (6) 
/i2(X,iV) = ^^^±g^, (7) 

Note that ai is not divided by t{X, N). The reason behind this is a very simple one - we have 
previously assumed that a modeled market contains N — X rational and long term fundamen- 
talist traders, whose individual behavior should not depend on the temporary fads and moods. 
It is possible to use other assumptions as the model is rather fiexible. 

The further stochastic treatments of the model, mainly relying on the van Kampen birth- 
death process formalism [V^] and the Ito rules for variable substitution [''( i], leads to the following 
stochastic differential equation for new stochastic variable, y = ]y3^, introduced as a measure 
of the absolute return [221 : 



dy 



^ 2-82 

ny) 



:i + y)dt, + ^l^{l + y)dW,, (8) 



here tg = ht. This stochastic differential equation in the limit of large y, y ^ 1, can be 
considered to include only the highest powers of y. In such case, and by assuming that r(y) = 
y'", one obtains: 

dy = {2- £2)y'+"dt, + ^/2f^dWs, (9) 
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Figure 2: Schematic representation of the three state model. The arrows point in the directions 
of the possible transitions, note that they can be grouped into three pairs. In our modelic 
setup each of the transition pairs is modeled using the original Kirman's model. The relevant 
parameters are grouped around the corresponding pairs of arrows. 



which is identical to eq. (1). The direct comparison of eqs. (1) and (9) yields the relation 
between the models' parameters: 

r7=^^, \ = e2 + a + l. (10) 

The direct consequence of the comparison is the ability to control the power-law exponents, 
A and /3, of the y statistical features obtained from the agent-based model, eqs. (6) and (7), and 
its stochastic treatment, eq. (8). This can be used to reproduce 1/ noise with 0.5 < (3 < 2 
(see fig. 1). Yet the most important result is the agent-based reasoning being provided for 
a very general class of power-law stochastic processes, reproducible by stochastic differential 
equations (1), derived from the point processes [16, 37, 17, 18]. 



3 Three state model with herding interaction 

In this section we extend the herding model by introducing the three state agent dynamics. 
One can easily extend the model by assuming that the original Kirman's transition probabilities 
describe the transitions between each pair of the agent states in the system. Thus in three 
state case with numbers of agents in each group Xi, X2, X3 we will have six one step transition 
probabilities of a general form given by: 

p{Xi + 1, Xj - 1, Xk) = X,{a,i + hj^Xi)^t. (11) 

The above holds for non-equal j and k each taking a value from the set {1,2,3}. Note 
that herding behavior is assumed to be symmetrical, thus we have hij = hji. The schematic 
representation of the extended model is given in fig. 2. 

Note that due to conservation of total number of agents A^, which is given by = Xi + 
X2 + X3, one can fully describe the three state system by the two dimensional state vector, 
X = {Xi,X2}. We assume that N is large enough to secure the continuity of Xj = Xi/N and 
introduce the definition of the transition probability densities, 7r*'-'(xi, X2) : 

p(Xi + t,X2+ J, X3 + A;) = Ar27r*'^-(a;i, X2)At. (12) 

Here the indexes i, j and k stand for the corresponding change of the number of agents in 
the corresponding populations. The indexes i, j and k must take different values from the set 
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{— 1, 0, 1}. Consequently, i + j + k = and vector {i,j, k} can be fully described by its two 
components 

The transition probabilities imply the Master equation for the probability u{xi,X2,t) to 
find the system in the state {xi, X2} at given time t: 

dtco = J2 (E'"' - 1) vr-^'-^w, (13) 

here i and j are two non-equal indexes, which take values from the set { — 1, 0, 1}. In the above 
E*'-' is the two variables one step operator, which is a convenient generalization of the one 
variable one step operator used by van Kampen in [35]. The form of the two variables one step 
operator is given by: 

E'''[f{x,y)]=f{x + tAx,y + jAy), (14) 

here i j E {—1, 0, 1}, Ax and Ay are the smallest possible increments of x and y respectively. 
Note that the operator acts on all functions on its right side. 

We expand this one step operator, using the Tailor series in the limit of small increments, 
Ax and Ay, up to the second order terms. By recalling that in our case Ax = Ay = (it 
follows from the definition of the almost continuous Xj) we obtain a Fokker-Plank equation, 

dtuj = -j2 d.. [Dlu] + J2 d.. {d., [Dlu] } , (15) 

where i and j belong to the set {1, 2}, and 

D\ = (^21X2 + cr3i(l - X2 - xi) - (0-12 + cTi3)a;i, 

Dl = cri2Xi + (732(1 - X2 - Xi) - ((721 + Cr23)x2, 

Dj^ ^ hi2XiX2 + hisXi{l ~ X2 - xi), (16) 
D22 ~ ^i2a;ia;2 + /i23a^2(l ~ X2 - xi), 

D12 = Dli ~ -hi2XiX2. 

The obtained Fokker-Plank equation appears to be complex, but it can be simplified after some 
additional assumptions. The financial market interpretation based on the three state model 
also enables us to make smooth transition to the system of stochastic differential, Langevin, 
equations. 



4 Financial market model with the three agent groups 

Let us start by assuming that the three states available to the agents in the aforementioned 
setup correspond to the three types of traders: fundamentalists, chartists optimists and chartists 
pessimists. In the current agent-based modeling it is one of the most common choices [6, 12]. 

Fundamentalists are the traders who have fundamental understanding of the true value of 
the traded stock. This understanding is quantified as the stocks fundamental price, Pf{t). For a 
mathematical convenience and without loosing generality one can assume that the fundamental 
price does not vary with time. In other words, we are interested in the price fluctuations 
according fundamental its value. Having this knowledge available to them the fundamentalists 
make rational long term expectations. Thus their excess demand, EDf{t), is given by [2 I]: 

EDf{t)=Nf{t)\n^^, (17) 

where Nf{t) is a number of the fundamentalists inside the market and P(t) is a current market 
price. The mathematical expression for the excess demand of the fundamentalist traders can 
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be read as - if P/ < P{t), the fundamentalist will sell the stock as he expects a decrease of 
price, while in the opposite case, Pf > Pit), he will buy stock expecting price growth. This 
behavior is based on the assumption that P{t) should converge towards Pf given enough time. 

The other two types, pessimistic and optimistic chartists, are short term traders, who es- 
timate the future price based on its recent movements. Namely these traders rely on the 
technical trading strategies and short term opinion fluctuations. As there is a wide selection 
of such strategies and opinions, one can simply generalize by assuming that some strategies 
and opinions at a given moment are optimistic, i.e. suggesting to buy, while the others are 
pessimistic, i.e. suggesting to sell. In such case the excess demand of the chartist traders, 
EDc(t), is given by: 

ED,it)=ro[Kit)-Npit)], (18) 

where ro is a relative impact factor of the chartist trader. No and Np are the total numbers of 
optimists and pessimists respectively. In the previous approaches [22, 24] chartist traders were 
considered to be a single group, opinion switching in which was assumed to be purely random, 
thus over-simplifying the endogenous mood dynamics. 

Price and later returns can be introduce into the model by applying the Walrasian scenario. 
As a fair price is assumed to reflect the current supply and demand, the Walrasian scenario in 
its contemporary form may be expressed as: 

^ ^^(^) -nf{t)p{t) + ro[no{t) - n^it)], (19) 



dt 

here /3 is a speed of the price adjustment, a total number of traders in the market, p{t) 

N 



In^ and n,(t) = By assuming that the number of traders in the market is large, 



A^ — )■ oo, one obtains: 



p(t)=.„ "°(')-"'W . (20) 

nf{t) 



Consequently the expression of the return in the selected time window T is given by 

'no(t) - np{t) no{t - T) - np{t - T) ' 



r{t) = ro 



rifit) rifit-T) 



(21) 



In the previous approaches [22, 24] the expression for the returns, eq. (21), was simplified by 
assuming that the chartist traders change their opinion significantly faster than the fundamen- 
talist traders. Further in this work we will use this assumption as well as regarding eq. (21) as 
a definition for the return. 

Note that in the above discussion we introduced some assumptions about the three agent 
states, which ought to be considered in the financial market scenario. We can further develop 
these ideas and simplify the Fokker-Planck equation obtained in the previous section for the 
general case of the three state model. First of all let us link the states with actual agent types: 

xi = nf, X2 = np, X3 = no. (22) 
Next let us point out the lack of qualitative difference between optimism and pessimism: 

(^23 = 0"32 = 0-cc, Cri2 = CTlS = Cr/c/2, (T21 = CT31 = (T^f, hi2 = /i-is = h. (23) 

Finally let us use the assumption that chartists change opinion significantly faster than funda- 
mentalists: 

h23 = Hhi, if > 1, (Tec > (Tcf, (Tec > (T fc, (24) 

where H is a speed ratio. 
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Under the financial market scenario the terms of the Fokker-Plank equation derived in 
previous section, eq. (16), can now be reexpressed as: 

Dj = ae/(l - Uf) - afcUf, 
Dl acc{l -nf - 2np), 
D}f^h{l-nj)nf, (25) 
^ Hhinp{l - Uf - Up) + hiUfUp, 



5 The system of stochastic differential equations for the 
three state model 

It is useful to derive the stochastic differential equations analogous to the Fokker-Plank equation 
(15). The general form of a stochastic differential equation in the case of two variables can be 
written as 

d\n) = \R)dt+[S-d\W)l (26) 

with the state vector vector of the relaxation functions matrix of the diffusion functions 
S, and the vector of Brownian motion \W). 

The elements of the matrix of the diffusion functions, S, are related to the second order 
terms of the Fokker-Plank equation as [38] 



]:^SikSjk, (27) 



Vfc 



After substituting the D~j for the expressions from eqs. (25) we obtain a system of a three 
linearly independent equations for the four elements of S. It is convenient to additionally 
assume that Sfp = Spf. Then by solving eqs. (27) we obtain all of the diffusion functions. 
Consequently we obtain the system of the stochastic differential equations: 

duf = [(1 - n/)ac/ - rifafc] dt + y/2hinf{l - nf)dWi, (28) 
dup = {1 — Uf — 2np)accdt + ^j2Hhinp{l — nj — np)dW2. (29) 

Interestingly enough similar equations are obtained for the evolutionary three strategy games 
in the series of papers by Traulsen et al. [39, 40, 41]. 

The above stochastic differential equations are inter-dependent, while it would be more 
convenient to have a system of independent stochastic differential equations. Taking into ac- 
count the previous approaches [22, 24] one can expect that the introduction of the mood, 
^(t) = ^"mI^^m ; as a new variable instead of n„ would solve this problem. This can be done ei- 
ther via Ito rules for variable substitution in Langevin equation [''"] or via variable substitution 
in the Fokker-Plank equation [ is]. 

At this point let us scale the time, ts = hit, and appropriately redefine the model parameters: 
£cf = cTcf/hi, Efc = (Tfc/hi, Ecc = CTcc/iHhi). Let us also recall our generalization of the herding 
model, eqs. (6) and (7), by introducing the additional variability of the event rate, r(. . . ). The 
same assumptions can be used to introduce the variability into the three state model. In such 
a case one can get: 



dn 



f 



{l—nf)ecf 



+ (30) 



= _2i£s^dt + J?^^diy,2, (31) 



rinf,0= 1+ ■ (32) 
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Figure 3: Probability density function (a) and power spectral density (b) of absolute return 
numerically calculated from the three state agent-based model. The red squares represent the 
numerical results obtained by solving eqs. (30) and (31). Model parameters were set as follows: 
Ecf = Efc = £cc = 'i, H = 100, ro = 1, a = 2. The black curves provide power-law fits: (a) 
A = 3.67, (b) /3i = 1.42 and /32 = 0.41. 



Note that in previous approach [ ' "] we have defined t(. . . ) as an inverse function of y, namely 
r 1 

T^Uf) = = . This form was selected for the sake of simplicity and also considering 

the limit of large absolute returns, y ^ 1. In the three agent group approach we choose to 
move further away from this simplification and introduce an inverse dependence on the log- 
price, p = ^ , thus arriving at the eq. (32). Similar approach was used in [cS], where the 
utility functions of the agents, and consequently their opinion switching, are dependent on the 
log-price. 

In fig. 3 we show that this model possesses a fractured spectral density similar to the one 
obtained in the sophisticated stochastic models considered in [20, 21]. The probability density 
function is a g-Gaussian like and has a power-law tail with the close-to-empirical exponent. 
Though the spectral density is fitted by the power-law functions with larger exponents than 
the empirical ones. The same behavior was also observed in the stochastic model for the absolute 
returns. In case of [20, 21] the model's spectral density was reconciled with the empirical data 
by applying the additional g-Gaussian noise driven by the resulting time series. In a sense of 
the proposed stochastic model derived as endogenous fiuctuations of three agent groups we can 
expect that the system's response to the exogenous fiuctuations of information fiow is defined 
by endogenous macroscopic state. 



6 Conclusions 

In this work we derived the system of stochastic equations (29) modulating dynamics of three 
agent groups with herding interaction. Proposed approach can be valuable in the modeling 
of the complex social systems with similar composition of the agents. We demonstrate how 
sophisticated statistical features of the absolute returns in financial markets can be reproduced 
by extending the herding interaction of the agents and introducing the third agent state. For- 
tunately, the model retains its macroscopic treatment by the stochastic differential equations 
(30) and (31). Faster transitions between optimism and pessimism introduce two time scales 
of the model reflected in the fractured power spectral density flg. 3 (b). This is in qualitative 
agreement with the high-frequency empirical data, which exhibits a similar behavior with lower 
exponents of the spectral density of the absolute returns [32, 21]. Agent-based model in the 
present form considers only the endogenous fluctuations, while the exogenous fluctuations are 
related to the information flow and would be considered as additional noise. Earlier we pro- 
posed a double stochastic model, which demonstrates the influence of additional noise reducing 
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exponents of power spectrum [20, 21]. 
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